Convolutional neural networks for segmentation of FIB-SEM nanotomography data from porous polymer films for controlled drug release

Phase-separated polymer films are commonly used as coatings around pharmaceutical oral dosage forms (tablets or pellets) to facilitate controlled drug release. A typical choice is to use ethyl cellulose and hydroxypropyl cellulose (EC/HPC) polymer blends. When an EC/HPC film is in contact with water, the leaching out of the water-soluble HPC phase produces an EC film with a porous network through which the drug is transported. The drug release can be tailored by controlling the structure of this porous network. Imaging and characterization of such EC porous films facilitates understanding of how to control and tailor film formation and ultimately drug release. Combined focused ion beam and scanning electron microscope (FIB-SEM) tomography is a well-established technique for high-resolution imaging, and suitable for this application. However, for segmenting image data, in this case to correctly identify the porous network, FIB-SEM is a challenging technique to work with. In this work, we implement convolutional neural networks for segmentation of FIB-SEM image data. The data are acquired from three EC porous films where the HPC phases have been leached out. The three data sets have varying porosities in a range of interest for controlled drug release applications. We demonstrate very good agreement with manual segmentations. In particular, we demonstrate an improvement in comparison to previous work on the same data sets that utilized a random forest classifier trained on Gaussian scale-space features. Finally, we facilitate further development of FIB-SEM segmentation methods by making the data and software used open\ua0access

Single-shot self-supervised object detection in microscopy

Object detection is a fundamental task in digital microscopy, where machine learning has made great strides in overcoming the limitations of classical approaches. The training of state-of-the-art machine-learning methods almost universally relies on vast amounts of labeled experimental data or the ability to numerically simulate realistic datasets. However, experimental data are often challenging to label and cannot be easily reproduced numerically. Here, we propose a deep-learning method, named LodeSTAR (Localization and detection from Symmetries, Translations And Rotations), that learns to detect microscopic objects with sub-pixel accuracy from a single unlabeled experimental image by exploiting the inherent roto-translational symmetries of this task. We demonstrate that LodeSTAR outperforms traditional methods in terms of accuracy, also when analyzing challenging experimental data containing densely packed cells or noisy backgrounds. Furthermore, by exploiting additional symmetries we show that LodeSTAR can measure other properties, e.g., vertical position and polarizability in holographic microscopy